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Abstract — Low density parity-check (LDPC) codes are a class 
of linear block codes that are decoded by running belief propa- 
gation (BP) algorithm or log-likelihood ratio belief propagation 
(LLR-BP) over the factor graph of the code. One of the 
disadvantages of LDPC codes is the onset of an error floor at 
high values of signal to noise ratio caused by trapping sets. In 
this paper, we propose a two stage decoder to deal with different 
types of trapping sets. Oscillating trapping sets are taken care by 
the first stage of the dcecoder and the elementary trapping sets 
are handled by the second stage of the decoder. Simulation results 
on regular PEG (504,252,3,6) code shows that the proposed two 
stage decoder performs significantly better than the standard 
decoder. 

I. Introduction 

Low Density Parity-Check (LDPC) codes were proposed by 
R. Gallager in 1963 fl] and was rediscovered by Mackay Q 
in late 1990s. Since they are based on sparse parity-check 
matrix, iterative decoders becomes an attractive option. Due 
to the near-capacity performance and the low complexity of the 
decoder they have become an intensive research topic among 
the coding theory community. 

A LDPC code can be described by a parity-check matrix 
H that is represented using a special type of graph called 
factor graph. A factor graph is a bipartite graph with two 
different types of nodes, variable nodes and check nodes 
corresponding to the columns and rows of the parity-check 
matrix H. H{i,j) — 1 corresponds to an edge between the 
variable node Vj and check node c^. 

Unlike the maximum a-poteriori probability (MAP) decod- 
ing algorithm that seeks for the global optimization over the 
whole code word space, belief propagation (BP) algorithm 
seeks for a local optimization by using only the information 
that is flowing through the variable nodes, without the knowl- 
edge of the global state. BP algorithm achieves this by passing 
messages iteratively between the variable nodes and check 
nodes. The message mi-cj at iteration I from the variable node 
Vi to the check node Cj can be interpreted as the probability 
that the variable node Vi is in state x in the absence of the 
check node Cj. Similarly, the message mc^vi at iteration I from 
the check node Cj to variable node Vi is the probability that 
the check node c, is satisfied in the absence of variable node 



The main problem with LDPC codes is that these codes tend 
to exhibit a sudden saturation for sufficiently high signal to 
noise ratio (SNR). Trapping sets |3| are considered the primary 
reason for this behavior of LDPC codes. In this paper, we 
propose a two stage decoder that in the first stage averages the 



messages from the selected variable nodes over two iterations 
and the nodes are selected if the belief in the node is decreasing 
below a certain threshold or if the belief is increasing rapidly. 
The decoded string is checked if it has converged to a valid 
code word in each iteration. If the decoded string has not 
converged to a valid code word even after maximum number 
of iterations and the number of check nodes that are not 
satisfied is below a certain threshold, we proceed to the second 
stage of the decoder where we flip certain bits connected 
to the unsatisfied check nodes. Then the first stage of the 
decoding process is repeated for the processed string. The 
selective averaging of the messages in the first stage slows 
down the information flow from the nodes affected by the 
trapping sets and the remaining variable nodes are not affected. 
These reliable nodes grow in belief and helps in solving the 
oscillating trapping sets. The elementary trapping sets are an 
unstable equilibrium, flipping some of the bits in trapping set 
will break the trapping set. This is the intuition behind the 
second stage of the proposed decoder 
The paper is organized as follows, 
basic decoding algorithm. 



II-A explains the 



II-B contains a description of 



trapping sets and how they affect the performance of the 
decoding BP algorithm. § II-C explains the various methods 



proposed in literature for improving the decoder performance. 



Ill proposes our two stage decoder and analyses how they 



improve the performance from the trapping set point of view. 



IV gives the simulation results to prove that the proposed 



algorithm does better than averaging decoder and standard 
decoder We provide the concluding remarks in § [V] 

II. Background 

A. Decoding Algorithm 

The parity check matrix of the LDPC codes are represented 
by a bipartite factor graph composed of N variable nodes Vj, 
for j £ {1,...,N}, that represent the message bits in the 
codeword and M check nodes Ci, for i e {!,... , M}, that 
represents the parity-check equations. The channel considered 
here is the additive white Gaussian noise (AWGN) channel. 
There are two types of decoding algorithms . The standard 
belief propagation (BP) algorithm which uses product of prob- 
abilities as messages and the other being a modified version 
of BP algorithm which uses loglikelihood ratio (LLR) as the 
messages between the nodes. In general the log likelihood 
ratio belief propagation (LLR-BP) algorithm is prefered for 
computational accuracy. The sign of LLR indicates the most 



likely value of the bit (0 or 1) and the absolute value of the 
LLR gives the reliability of the message. 

Let mi-cj be the message passed from a variable node Vi to 
a check node Cj at the /*'* iteration of the algorithm. Similarly, 
one can define nic-vi- The initial values of the message niviCj 
is equal to the channel information LLR Cy- of the variable 
node Vi and it is independent of Cj. We have 
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where N{vi)\cj denotes the neighbors of Vi excluding Ci and 
N{ci)\vj denotes the neighbors of c^ excluding Vj. 

The algorithm follows the flooding schedule in which an 
iteration consists of simultaneous update of all the messages 
TOt,.c , followed by the simultaneous update of all the mes- 
sages nic Vi- The decoding algorithm stops if the decoded bits 
satisfy all the parity-check equation or maximum number of 
iterations is reached. 

B. Trapping sets 

The notion of trapping set was described in the context of 
error-floor analysis in Q. This concept was further developed 
in the seminal paper by Richardson (3), in which trapping set 
configurations were shown to exhibit a strong influence on 
the point of onset as well as on the slope of the error-floor 
curve of LDPC codes. 

Trapping set is defined as follows. An {x, y) trapping set t 
is a configuration of x variable nodes, for which the induced 
subgraph contains y > odd degree check nodes. 




Fig. 1. (6,2) Trapping set 

An example of a trapping set can be seen in Figure [T] In the 
above figure we can see six variable nodes and two unsatisfied 
check nodes. A trapping set always has some unsatisfied check 
nodes. This is how we differentiate the error due to trapping 
set and the error that occurs due to minimum distance of the 
codes. 



There are three types of error events in the error floor region 
|5|. They are 

1) unstable error events, which dynamically change from 
iteration to iteration and for which x and y are typically 
large, 

2) stable or elementary trapping sets, for which x and y 
are small and are the main cause of the error floor and 

3) oscillating trapping sets, which periodically vary with 
the number of decoder iterations and which are some 
times subsets of stable trapping sets. 

As explained in |6|, the onset of of error-floors in LDPC 
codes can be attributed to the following phenomena. In the 
initial stages of the belief propagation, due to presence of 
low-probability noise samples, variable nodes internal to one 
particular trapping set (initial trapping set) experience a large 
increase in belief towards the wrong bit value. This informa- 
tion gets propagated to other variable nodes in the trapping set, 
some of which already have very low belief in their bit value. 
After this initial increase in belief, external variables usually 
start adjusting the incorrect estimates towards the correct bit 
values. By this time the variable nodes in the trapping sets that 
are affected by the inital information surge are significantly 
biased towards the incorrect bit values. Since there are only 
a few check nodes capable of detecting errors within the 
trapping sets, this incorrect bit estimates remain unchanged 
until the end of the decoding process. 

The trapping sets are union of several cycles. One of the 
most prevalent types of error in the waterfall region is the 
oscillating trapping sets which causes the LLR values of a 
node to oscillate. This could be caused by two or more cycles 
passing through a node. When the messages looping in the 
cycles supporting different bit values arrive at the variable 
node at different times, the LLR values seems to oscillate. 

C. Related Work 

A lot of research has gone into designing decoders to mitigate 
the errors caused by the trapping sets. The decoders are 
designed in such a way that the computational complexity of 
the modified decoder is not high compared to the standard 
decoder. 

In f6\, the problems caused by the trapping sets and why the 
decoder fails in overcoming these problems are well studied. 
Landner et al. |J6l, ||7) propose an averaging decoder that 
averages the LLR value of the node over several iterations. 
Averaging prevents the erroneous information from being 
trapped in the code graph by slowing down the convergence 
speed of the nodes. This method though computationally less 
complex, it slows down the convergence of the reliable nodes. 
This affects the performance of the decoder in the waterfall 
region as oscillating trapping sets are prevalent in this region 
than the elementary trapping sets. 

In Is), the BP algorithm is well studied in the point of view 
of the Bethe energy and how it fails in the presence of cycles. 
They propose a BP algorithm with a tunable parameter A and 
a modification to the outgoing message from the variable node. 
On adjusting the parameter A at different SNR points, they 



are able to achieve better performance than the standard BP 
decoder. This modification also follows the same principle as 
the averaging decoder by slowing down the information flow 
to prevent the trapping of the erroneous information. 

The work put forward in (9] concentrates on short and 
middle length LDPC codes as they are largely affected by 
cycles in the graph. These cycles causes the oscillation of the 
LLR values in the nodes. The messages from the previous 
iteration is added to the message in the current iteration if 
the sign of the message changes. This modification helps in 
damping the oscillation, but their method does not handle the 
errors caused by elementary trapping sets. 

A two stage backtracking decoder was proposed in pO| 
^T\. The fact that an unsatisfied check node is connected 
to odd number of variable nodes in trapping set is used to 
construct a matching set ^I*. Then each variable node that 
belong to the matching set ^ is flipped seperately and the first 
stage is run. This process is repeated till the error is solved or 
all the nodes in the matching set have been exhausted. 

III. Proposed Algorithm 

The proposed decoding algorithm consists of two stages. 
The first stage is selective averaging decoding in which we 
concentrate on the oscillating trapping sets. If the decoder does 
not converge after a fixed number of iterations and the number 
of unsatisfied check nodes is below a certain threshold, we 
assume that it is due to elementary trapping sets and identify 
the variable nodes that are connected to the unsatisfied check 
node and multiply the channel information LLR Cy. with a 
constant and repeat the first stage of the decoder 

Our aim in the first stage is to prevent the error due to 
oscillating trapping sets and initial trapping set. One has to 
take care that the algorithm does not affect the convergence 
of reliable nodes. Faster convergence of the reliable nodes 
seems to help the convergence of the oscillating nodes as the 
messages from the converged reliable nodes are very strong 
compared to the belief in the oscillating nodes. As explained 
in § II-B the nodes affected by the initial trapping set have 



Algorithm 1 Node Selection 



a rapid increase in reliability value on the wrong bit and the 
errors caused by this can be prevented by slowing down the 
wrong information from flowing out of these nodes. 

The selective averaging algorithm modifies the outgoing 
messages niv-cj from the variable nodes as follows. 



m 



'(i) 



2 ■ 

(0 
mi /c . , 



if Selected{vi) > 
if Selected{vi) = 
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The messages from the check nodes TOc/uiare not modified. 

Algorithm [T] proposes the method for selection of nodes. 

L(^\ represents the log likelihood ratio of the node Vi at 



-(i-i) 



iteration I and L;', ^''' represents the log likelihood ratio of the 
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node Vi at iteration /—I. We assign ILY' . I to BY' , and \L, s'\ 

to -BL ^ ■ We then check if the belief in the node B(^^.^ is 
decreasing or increasing with the iteration. If the belief is 
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decreasing below a constant /?, we assume this as an oscillating 
node and the node is selected. If the belief is increasing rapidly 
at a rate above the constant v, we consider this behaviour as 
an initial trapping set and the node is selected for averaging 
of the messages in the next iteration. This condition also helps 
prevent the oscillating nodes. All the nodes are unselected at 
the beginning of the node selection procedure at each iteration 
except the nodes which are modified in the second stage of 
the algorithm. These nodes are assigned Selected{vi) = 2 and 
the messages from these nodes are always averaged. A more 
detailed explanation for this special treatment of the modified 
nodes will follow when we explain the second stage of the 
algorithm. 

The first stage of the decoder is not designed for dealing 
with the elementary trapping set which is the most prevalent 
type of trapping set in the error floor region. We will use a 
similar algorithm to the one proposed in |10|. The algorithm 
proposed in flO) pT) , uses a backtracking approach and 
forming a set of matching sets of vertices which might belong 
to the trapping set. The initial LLR value of the variable nodes 
that belong to one of the members of the set of matching set 
is flipped and the decoding process is repeated. If the trapping 
set error is not solved, then the decoder backtracks and repeats 
the process for the next member of the set of matching set. The 
second stage of our decoder also follows a similar approach 
but we avoid backtracking as it increases the complexity of 
the decoder. 

Algorithm [2] lists the second stage of the proposed decoder 
If the first stage of the decoder has not converged even after the 
maximum number of iterations and the number of unsatisfied 
check nodes is below CNthreshoid which is a very small 
number (Trapping set errors are low weight errors in error 
floor region), we conclude that the error occured is due to an 
elementary trapping set. As the trapping set is an unstable 
equilibrium condition, if we flip even one or two variable 
nodes that belong to the check nodes, it is enough to break the 
trapping set. But we do not know which variables nodes belong 
to the trapping sets. The only information that is available to 



Algorithm 2 Second Stage of the decoder 
1: First stage decoder unsuccessful. 
2: Find the set C of unsatisfied check nodes. 
3: if \C\ < CNthreshoid then 

4: Vhatoid ^—output of first stage of the decoder 
5: Find the set of variable nodes Vun where ]/„„ = 
U N{c,). 

CjGC 

N{cj) is the set of all variable nodes which are con- 
nected to the check node Cj. 
6: Find the subset of variable nodes Vnc ^ Vun such that 
no two variable nodes have common check nodes other 
than the unsatisfied check nodes. 

7: for Vk e Vnc dO 



= -c, 
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C(i,j.) is the channel information LLR of the variable 

Vk 

Selected{vk) ^- 2 
end for 
end if 
re-decode with the the new channel information LLR 

if re-decode is successful then 

stop and exit 
else 

Vhatnew <— output of re-decode. 

Find the set C" of unsatisfied check nodes. 

if \C\ < \C'\ then 
output Vhatoid- 

else 

output Vhatnew 

end if 
end if 



us is that the unsatisfied check nodes are connected to odd 
number of variable nodes (one node in the worst case) in the 
trapping set as shown in Figure [T] We find the set of variables 
nodes Km that is a union of all variable nodes connected to the 
unsatisfied check nodes. Find a subset Vnc ^ Vun such that no 
two variable nodes in the set Vnc has a common check node 
other than the unsatisfied check nodes. We will multiply the 
initial LLR value C„^ with -1 and rj. This flips the bit value 
of the node and the decoding process is repeated. But some of 
the correctly decoded nodes which do not belong the trapping 
set might also be flipped. Since the variable nodes do not have 
any common check nodes, the wrongly flipped nodes are easily 
corrected by other reliable nodes in the decoding process. If 
the re-decoding is not successful, then we report the string with 
the least number of unsatisfied check nodes. To be cautious we 
assign Selectedivk) = 2 so that they remain always selected 
and the messages from these nodes are always averaged. This 
helps in preventing the wrong information from spreading 
intially before the reliable nodes converge. The nodes that we 
have flipped in this stage that belong to trapping set will help 
in breaking the trapping set. 



IV. Simulation Results 

We ran simulations of the proposed decoder for (504,252,3,6) 
regular PEG code at different SNR points. We compare the 
results of the proposed decoder to the averaging decoder 
||6) and standard decoder Without loss of generality, the 
codewords send were all-zero. 
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Fig. 2. Comparison of BLER (504,252,3,6) regular PEG code 
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Fig. 3. Comparison of BER (504,252,3,6) regular PEG code 

In Figure |2] [3] we can see that the proposed two stage 
decoder performs better than the other two decoders in both bit 
error rate (BER) and (BLER). This performance is expected 
because the proposed two stage decoder solves the trapping 
sets better than the averaging decoder ||6) and standard de- 
coder 

In Figure [4] we can see the number of bit errors in the 
decoder after processing in the second stage of the decoder 
and the number of bit errors in the averaging decoder We can 
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Fig. 4. Comparison of the error performance of two stage decoder and 
averaging decoder. 



see that the second stage of the proposed decoder helps in 
solving the error due to the elementary trapping sets. 

We can improve the second stage of the decoder by de- 
creasing the number of bits flipped that do not belong to the 
trapping sets. We are also working on error-floor prediction 
methods which will be useful for high SNR value where 
simulation is not a possibility. 

V. Conclusion 

In this paper, we proposed a two stage decoding algorithm 
for LDPC codes that reduces the error performance of the 
code especially in the error floor region. In the first stage 
we handle the oscillating trapping sets by selecting the nodes 
based on rate of increase or decrease of the belief. The 
messages from the selected nodes are averaged with message 
from the previous iteration to slow down the flow of erroneous 
information in the system. The reliable nodes are allowed to 
converge faster and they help in solving the oscillating trapping 
sets. The first stage decoder does not solve the errors due to 
elementary trapping set. To address this we added a second 
stage to the decoder that flips bits that are connected to the 
unsatisfied check nodes. This helps in breaking the trapping 
sets. 
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